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Method of and system for presenting media content to a user or group of users, computer 
program product, infonnation carrier, entertainment device 



The invention relates to a method of presenting inedia content to a user or 
group of users, wherein tiie media content resides on a storage system. 

The invention fiirther relates to a system for presentixig media content to a 
or group of users, wherein the media contesit resides on a storage system. 

The invention iurther relates to a computer program product designed to 
pafoim such a method. 

The invention further relates to an information earner conq)rising such a 
conqmtor program product. 

The invention further relates to an entertainment device comprising such a 

system. 



An embodiment of sudi a msfliod and system is described in US Patent r 
6.3 1 1,194. Here, a system and method for creating a database of metadata of a variety of 
digital media content, including TV and radio content deUv^ on the Intemet is described. 
The method captures and etihanoes domain or subject specific metadata of digital media 
content, including the speoijtio meaning and intended use of original media content To 
support semantics, a WorldModel is provided that includes specific domain knowledge, 
ontologies as well as a set of rules relevant to the original content One of the languages that 
is used to express ^ domain knowledge is the Extensible Markup Language (XML), as 
defined by the World Wide Web Consortium (W3C), see htlp:/Avww. w3 .org The database of 
metadata may also be dynamic in that it may track changes to the media content, including 
Kve and archival TV and radio programming. The database of metadata can be queried by a 
user. Hereto, a user must specify the domain of interest of Ihe WorldModel and then the user 
is presented wiHi a &im that contains fields for each of the attributes that belong to that 
domain. The user must fiU in this form and submit the form to execute the query. An other 
way of submitting a query can be performed by letting the user choose a domain and enter 
keywords. A third way of submitting a query is established by supplying a user interface that 
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is custoinized to a single domain. The user can then select the u^er interface of the domain 
that the user whishes to query, All these queries require explicit user interaction. 



5 It is an object of the invention to provide a method according to the preamble 

that retrieves media content in an improved way. To achieve this object, die method 
comprises defining a query to retrieve the media cont^tif; which query is appropriate for the 
user's situation by using context informatLOi^ retrieve the queried media content fit>m lite 
storage system; and presenting the queried media content to the user or group of users. By 
10 combining sensor data about a user's situation with contend: infomiation, high level user 

situations dan be derived. For example, it can be derived that the us^ is at home and relaxing 
when it is detected that the user is home alone and sits iu his or hers &vorit6 amichair, 
Derivatiou of the context information can be perfonned automatically without explicit user 
interaction. 

15 WO 01/69380 describes the use of context information in order to create a user 

jnter&ce to enable a user to retrieve content from a database. The context infoimation 
comprises descriptive Informaiion about the abilities of a user. The descrqstive in£mnation is 
supplied to the system explicitly by the us^. The context information can further comprise 
the operating context conditions of the user, lilce situational) environmental, behavioral and 

20 the location of the user like at home or in a car. The coptext information is used together with 
the descriptive infomiation to compute preferences for the specific user and create a user 
interface that is operable by the xiser. For example, wh®a a user cannot use his or her 
extremities, it can be drtermined that control and entey functions are not to be operated using 
hands, but that voice is preferred for these modes of interaction. Therefore, only the 

25 presentation and operation of access controls are influenced by the context information. 
However, the content that the user wants to retrieve is not effected by this context 
inforoiation. 

An embodiment of the method according to the invention is described in claim 
2. Within this embodiment, the context information comprises at least one of sensor data 
30 about at least one person present, sensor data about at least one object present, a context- 
dependent user profile, a context-dependent group profile. In this way, for example a person 
can be recognized, the individual persons of a group or just the number of people can be 
counted, in order to determine the user's situation automatically. Furthermore, objects that 
are present within the environment can be taken into account For example, when there are a 
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lot of persons present and the room is decorated with ballooiw, it can be derived that a party 
IS going on and that party music should be retrieved from (he internet. As an ofter example 
the music preferences of a number of people within a group can be uaed to retrieve muao ' 
from the internet that all these people like. The contact infonnation can also take a groi^ of 
5 persons into account in stead of only liie individuals. 

An embodiment of the method according to the invention is described in claim 
3. Within this embodiment, the context infonnation conqmses a combination of events of 
which each event is described by means of at least one of Inftmnation about space, 
information about time, and information about who or what is described by the re^ective 
XO event. Moreover, it can be usefiil to lecoid metadata about events, including, for example 
who or what stated the event Space can describe both physical space and virtual space, like 
the world wide web (a set of Uni&nn Resource Identifiers, UBJs). This general way of using 
events enables reasoning about context infbmiation. and may simplify «Kpresdons of and 
reasoning with context knowledge. Furthermore aU kinds of user dmations can be expressed 
by events. For example, an object can be regarded as an event; a time interval can be 
regarded as an event; a pernon can be regarded as an event, perhaps regarded throughout his 
or her entire lifetime, or only fiw a day. and the presence of a person in a certain place during 
a cextein hour can be regarded as an event. 

An embodiment of the method accoiding to the invention is described in claim 
4. Withmthisend^diment, the context infomiat^on contains a mathematical relation between 
the events to mable reasoning about the events. This enables to express that an event is 
composed of oiher events; that two events intersect, etc. In particular, such mathematical 
relations betweeu eveuts allow concisions such as that a certain event can be concluded to 
^ly to a certain context, wfacax certain other events are known to apply to the context In this 
way, me high-level us^a: situations ahready mentioned can b e derived from low-level sensor 
data about context of use. This derivation process may take several steps. 

An embodiment of the method according to the invention is described in daim 
5. Within this embodiment, events con^wise at least one of a physical event, a content event, 
a people event, and an inpm event. The physical, people and input events describe context 
By distinguishing between different kmds of events fhrther reasoning about events is 



enabled. 



An embodiment of the method according to the invention is described in claim 
6. Within this embodiment, the userprofile and the group profile are based upon at least one 
profile rule, and the at least one profile rule describes, for the user or gro\^ of usets, an 
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aotioii concerning which possible event should be realized according to the user or group of 
users when a given event takes place, and the method comprises the step of applying die at 
least one profile rule Co the context information which includes the given event, 141 order to 
determine the possible event. An action can for example be the action *'do". This action can 
5 require the realization of the possible event when the given event occurs. In a typical 
application, the given evmt in a profile rule describes context, and the possible event 
describes content But a profile rule can also be used to express other likes or dislikes or 
instructions, such as: given a certain song, another song is also very interesting; when the 
telepthone riugSa turn the sound level down; when I am alone and concentrated, please do not 

10 disturb. By using a conjunction to include two users in the given event of a rule, a profile for 
a specific pair of users can be built 

An embodiment of the method according to the invention is described in claim 
7. Within this embodimenti the possible event is detennined using a tating value and the user 
who gave the rating value. An example of an action that can appear in the profile rule> is the 

IS action to rate the possible event for the situation that the given event occurs. By including 
both the rating vahie and the u$er who gave the rating value, the importance of the rule can 
be deteonined. In some cases, for example, it can be desirable to give hi^ priority to the 
ratings determined by the person who hosts a group of people. 

An embodiment of the method according to the invention is described in claim 

20 8. Within this embodiment, a Semantic Web language is used to represent information itoout 
the media content and the context information. The term "Semantic Web" stands for a vision 
on the future of the World Wide Web, see Bemers-Lee, T. 1998. Semantic Web Road Map. 
World Wide Web Consortium, httD://www>w3.Qrg/Des ig pIssues/Semantiah^^^ Bemers-Lee, 
T., with Fischetti, M-, 1999. Weaving the web. Harper Collhis, New York; and Bemers-Lee, 

25 T., Hendler, J„ and Lassila, 0. 2001. The Semantic Web. Sci^tific American, May 2001, 
htt p://www,ficiBntificamerioaq.com/2Q01/05Ql^ The Semantic 

Web languages can be used to fiacilitate representation of and reasoning with information on 
the internet. For this purpose, the Rffiource Description Framework, see 
hlt p://www.w3 .ore/TR/REC^rdf-syntax (RDF) and RDF Schema, see 

30 htt p://www.w3.Qtg/TR/2000/CR-rdf-schema-20000327 and the Web Ontology Language, see 
htt p://www.w3.ors/2QQl/sw/WebOniy (OWL) can be used. 

An embodiment of the method according to the invention is described in claim 
9, Within this embodiment, the user profiles of different users are separately stored on 
different places on the internet. By storing the user profiles on different places on the 



15 



20 



25 



30 



FHNL02107JE]P^ ^ on '^""ir! 10. 25^7^14 

. ^ ^ ^ 21.10.2002 

i^iiet, stomge capadty requirements are di3tnW over a numb^ 
the mtemet FUrthennore, fee user profiles can be accessed &om 6m^ places and there's 
tioneed for several copies of a user profile stored at diflfer^at servers. By having thdr 
preference file available on the internet, possibly protected for private use only users can 
5 ^-^-fitfronithatprofileinapluraJiiyofsituations.Fore««nple,wh^ 

somewhere in the world, the room's radio can play music using the knowledge offered 
through those preferences, (This assumes that fee hotel's radio is part of an internet radio 
system.) Maintenance of fee user profiles can also be simplified, stece a user can update fee 
preference file and consistency problems ai« addr^sed wifeinfee context of that preference 
10 file. Fuxfeer. by using fee internet, it is possible to i^date fee preferences at any time fiom 
anyplace. 

«r ^'°^°'^'°*°^*^^^°*^^«'^*«*«»i^ventionisdescrib 
10. Wxfemfeis embodiment fee imownmafecmaticalrelattonsbetween events are located on 
acentral server. Ilnsin&nnationplaysacenlxalroleinfeepxocess to dei^^ 
are suitable for particular user situations. Ix^cating feis information on a cenlxal server 

fecilita1«sfeepossibifitytoexercisecontroloverfeisinfoxmation,inpartjcular 
(i^date)feisinfom,atian. Moreover, it leads to advantages wife respect to performance 
-K*a,iHty and securxty.In addition, feere is only one comieotionneeded to feis server t^ 
retrieve all of feis infonnation. Jh fee use of feemafeematical relations from fee seiver 
fransfotmaiions may be made to ofe«r forms of representation feat differ from fee way 'in 
which fliese relations were originally stored. 

.'^^^°'^^*<'f««»^«a«>daccordingtofeeinventionisdes<^bedincto 

11. Wifemfexsenfeodim^.1hemefeod comprises fee step of applyingaquery creation 
^gy. By applying different qu^ creation strategies, different media content can be 
retrieved &om fee internet based upon the same context information. Examples of such a 
query creation strategy are: everybody equal, dedicated to partioulsr user, host strategy or a 
mqj orLty strategy. ' 

An embodiment offeemefeod according to the invention is described in claim 

12. Wifein feis embodimeni, fee mefeod comprises fee step ofr^trie^lhe queried media 
contentbymeans of collaborative filtering. By using collaborative filt«ring,aw 
technique can be used feat has proven to be effective. It allows media content to be retrieved 
by means of queries feat are formulated in a rafeer geneml way, for example in tenns of 
keywords describing music genres, rafeer than identifiers of specific songs. 
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It is a ftprtJier object of the invention to provide a system according to the 
preamble that enables retrieval of media content in an improved way. To achieve this object, 
ttie system comprises: defining means conceived to define a query to retrieve the media 
content, the query beiag appropriate for the user's situation by using context information; 
5 retrieving means conceived to retrieve the queried media content from the storage system; 
and preseaniting means conceived to present the queried media content to the user. 

It i$ a further object of the invention to provide a computer program product 
according to the preamble that ©aables retrieval of media content hx an improved way. To 
achieve this object, the con^uter program product is designed to perfonn the method 
ID according to the invention. 

It is a further object of the invention to provide an information carrier 
according to 1ho preamble that enables retrieval of media content in an improved way. To 
achieve this object, the infoimatlon carrier comprises the compute program product 
according to the invention. 
15 It is a fiarfher object of the invention to provide aa entertainment device 

according to tlie preamble that enables retrieval of misdia content in an improved way. To 
achieve this object, tixe entertainment device comprises the system according to the invention. 



20 These and other aspects of the invention will be apparent from and elucidated 

with reference to the embodiments described hereinafter as illustrated by tbi^ following 
Figures: 

Figme 1 illustrates a global system arcMteoture of a media-related system^ 
Figure 2 illustrates a model of KDF data; 
23 Figure 3 illustrates ihe main parts of a system according to the invention in a 

schematic way; 

Figure 4 illustrates internet-enabled devices comprising the system according 
to the invention in a schematic way. 

30 

The term *Semantio Web* stands for an iuCTeasingly popular vision on the 
foture of the World Wide Web, see Bemers-Lse, T. 1998. Semitic Web Road Map. World 
Wide Web Consortium, htQ>://www.w3,org/DesigriIssues/Semaatic.htnil, Bem^:s-Lee» T., 
with Fischetti, M., 1999. Weaving the Web. Harper Collins, New York or Bemers-Lee, T., 



) 
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Hendler, J., and Lassila, 0, 2001. The Semantic Web. Scientific American, May 2001. 
Available electromcaUy at htlp:/Avw.soieiitificamericaiLoom/2001/0501issue/050lbemer5- 
lee.html. There is a serious effort toward the realization of the Semantic Web. The World 
Wide Web Consortium (W3C) organizes the development of languages to sappovt fbe 
) Semantic Web. 

Since its inception, the exisling Web allows people to view and retrieve data 
residing anywhere on the Web. The Semantic Web is intended to be a Weh of data fliat can 
be processed by machtoes. 

The existing Web can be viewed as a large n>ook% where data oan primarily 
be found via links to specific pages, or by looking &r the occutience of spedfio words on 
pages. The Semantic Web is envisaged as a large 'database' or *knowIedge base'. With an 
oidinary database, data can be foimd by specifying a request in tennsofthe meaning of what 
is desired. The Semantic Web is intended to record infonnation in a machine tmderetandable 
way, where understanding means nndciatanding meaning, or relating to things already 
understood, just as for people. 

Whereas the existing W^ can be viewed as the combination of Ifeitemet and 
hypertext, the Semautio Web is viewed as the combination of Mtemet and knowledge 
rspreaentationr in the field of knowled^ representation it is investigated how knowledge can 
be represented in such a way that reasoning with knowledge can be automated, lie Semantic 
Web might be described by the slogan make reastmins explicit. In the cmtent situation, 
reasoning processes often remain largely hidden, wiain Java programs, for example. The 
knowledge required by reasoning processes can be made explicit using XML, without the use 
of Semantic Web technology. XML does offer general means to specify grammar that can 
be used to specify the order of items in documents, but currently does not offer general 
means to specify the meaning of certain kinds of infonnation. A central point of the Semantic 
Web vision is to arrive at uniform mechanisms for representing knowledge and meaning on 
the Web. Facts and rules for drawing conclusions are to be explicitly represented on the 
Semantic Web, in such a way that any computer program can foUow ifae actual reasoning. 

The Semantic Web is intended to incjrease the possibiHty to develop intelUgent 
agents exploiting the Web. When data is expressed wiHi semantics, in a standardized way, the 
vision is that it could even be handled by a computer program that was not spedaUy 
developed to deal with this specific data. 

While the existing Web makes use of HTML and XML, flie Semantic Web 
exploits, in addition, a so-caUed ontology language for specifying meaning of information. 
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The staixdard Semaaitic Web languages will be based on XML, and will be accompanied by- 
standard implementations that can automatioally Incorporate basic inference st^s implied by 
information on the Semantic Web. Thereby, the Semantic Web languages and their 
Implementations facilitate the development of Web-based sy$tems with reasoning 
5 functionality. The first steps in this direction have been made with the QCML-based) 
languages RDF and RDF Schema. 

Figure 1 illustrates a global system architecture of a media-related system- The 
system presents media (music, video, games, etc.) in a way that adapts to the current context 
As an example, Uie pr^erences of people present can be used to detemiine suitable songs to 

10 be played. In addition to adaptation, direct user input is also allowedr Internet and Web 
technology can be applied to realize this kind of adaptivity. Tn patticxilar* Semantic Web 
technology can be used to £acilitate representation of and reasoning with information on the 
Ixxtemoti and an automated query formulation procedure is developed to connect to 
infomiation retrieval systems. The invention can make existing recommends systems 

15 conlext-aware, and applicable to groigjs of people instead of only individual persons. The 
invOTtion uses context information, which includes information about people and objects 
present, rules for reasoning about the context, and context-dependent user profiles. 

This section describes a global architecture for the development of media- 
related systems that know about the context of use and that can adapt to this context This 

20 architecture is depicted in Figure 1 • 

Lit^action with tiie users, and observations about the context of use, take 
place by means of various I/O devices, 102 to 108, For example, there can be input devices, 
output devices, sensors, and actuators. The input and output devices represent the tools for 
interaction between human and system, and include such devices as remote controls and 

25 displays- Media content can be provided to users by means of output devices. The sensors 
represent the devices that the system uses to detect or infer the cvwrent situation of the user, 
such that it can adapt the user-system interaction in a contort-aware manner- Of course, the 
$ystem can also use the infomiation received through the input devices. Examples of sensors 
are given by tag readers that seiase (the ID of) the objects in a room, or by equipment for 

30 automatic vision. 

The scope of the mvention is not solely restricted to the presentation of media 
content in forms such as audio, video, or graphics. The concepts of the invention can also be 
applied to take care of selection or adjustment of other conditions, like limiting or room 
temperature, in a way that diminishes the need for explicit user input. In this case, the I/O 
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devices previously mentioned include actuators controlling lighting or heating equipment, for 
example. In particular, it can for example be natural to accon:q)any media presentations with 
suitable adjustments of lighting conditions. 

A central part of the systOTOt architecture is fomied by an information store, 
which allows to desaib^ link and distribute infonnation about users, devices, content items 
and experiences on a global scale> in a machine understandable way. The phrase 'ambient 
information* is nsed to refer to the information about content and context required by 
context-aware, adaptive media systems. Making fliis ambient information 1 12 explicit on 
Ihe Semantic Web 110, allows us to customize the computing processes 116 to 124 involved 
in adaptation of content on the Web 1 14 for different user experiences involving different I/O 
devices 102 to 108. The I/O devices 102 to 108 communicate with these coni5)uting processes 
116 to 124 either directly by exdianging XML Or indirectly by writing XML (RDP) to the 
iSemantic Web, It should be noted that in this description of the global system architecture, 
the Semantic Web is just one way of oripnizing storing of ambient information. As an 
alternative to the Semantic Web, the ordinary Web could be used, or a centralized way of 
storing informatioUj, by means of database technology, for example. Analogously, content 
could be taken fiom a centralized content store, rather than from the Web- 

The realization of ambient information 1 12 as part of tiie Semantic Web 1 10 is 
done by distributing and li nki ng KDF documents. Real objects (e.g. persons, devices, 
physical objects) and virtual objects (e.g. content items, web services, general knowledge 
rules) can be associated with KDF documents that de$cribe these objects in a machine 
understandable way, Relations between objects can be described by linking tiiese RDF 
documents. 

The architecture of Figure 1 consists of a maintenance component and an 
operative component The maintenance component consists of cra^^^ling 122 and indexing 
processes 120. The operative component in Figure 1 consists of query formulation 124, 
information retrieval 118 presentation generationiprooQs^i^ 126. 

The first step is handled by the query formulation process 124. Its task is to 
analyze the input received firom the different input devices 102 to 108 either directly or 
indirectiy through the Semantic Web 110. Based on this information and the comext 
information that can be already present on the Semantic Web 1 10 it then calcidates a query 
and determines to which retrieval process 1 18 it should forward this query. 

The second step involves the execution of this query against one or more 
retrieval processed 118 hosted by one or more different content providers. The task of the 
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retrieval process 1 1 8 is to compare Mb query against the document representatioiis created 
by the indexing process 120 and return the hest matching document representations torn a 
database according to some undwlying similarily function. The retrieval process 118 
determines which document representations should be presented. Tlie retrieval process 1 18 
may be executed by different retrieval engines that are located at different servers. 

The third step, the presentation generatloii process 126, gcajeiates 
documents for the output devices 102 to 108 that sunound the user. Its first task is to analyze 
the output received by the retrieval process 1 1 8 and determine how these document 
rq)resentation$ can be struotored into new documeats fiiat can be presented to the user by the 
output devices 102 to 108. Based on Ms information and context information atoeady present 
on the Semantic Web 110 (e.g. knowledge about the device capabilities, the target 
plication, and the user) it then generates the documents and delivers the right document to 
fbo right output device (or stor^ the docmneait in the Semantic Web 1 10 for later use). The 
pres«atation generation process 126 determines in the end what the output devices 102 to 108 
should mterpret, e,g. present on screen. How this is actually done Is lefl to the output device 
102to 108itsel£ 

The ambiwt infonnation oonqionent 1 12, comprises the required infetmation 
about context and conjent Managemait of ambient infonnation can hivolve dat^aae aspects 
as well nfi AI aspects. The database aspects deal, f<Mr example, with data definitions, 
distribution over iil^, timisaction management, ooncutreocy, and security. The AT aspects 
involve knowledge representation and reasoning, for exan^le: what kind of concepts should 
be used to describe context, what sort of rules should be used to reason about context? 

In several ^>proaches to the problem to r^resent knowledge about context, 
there is a separation betweai static and dynamic aspects. For example, situation calculus, an 
approach that has been widely investigated in AI, distinguishes situations, at distinct points in 
time, between which transitions occur (see, e.g., McCarthy, J. 1963. Situations, actions and 
causal laws. Teohnioal Report, Stanford University, 1963. Reprinted in Semantic Infotmation 
Processing (M. Minsky ed.), MIT Press, Cambridge, Mass., 1968, pp. 410-417 or Russell, 
S.J., and Norvig, P. 1 995. ArUficial Intelligence. Prentice HaU, Englewood Cllfjfe). As 
another examples, temporal logic separates a layer of statements describing the validity in » 
time of certain other statements (see;, e.g., Allen. J.F. 1983. Maintaming Knowledge about 
Temporal Intervals. Commun, ACM 26(11) pp. 832-843 or Allen, JJf. 1984. Towards a 
general theory of action and time. Artificial Melligence 23(2) pp. 123-154). Such approaches 
tend to become complicated, for example when dealing with sinuiltaneous ev^te with 
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different durations. Tlxefefore, it ha^ advantages to integrate spatial and temporal aspects (see 
Hayes, P J., 1985. N^ve physics I: Ontology for liquids. Jh Hobbs, J.R. and Moore, R.C. 
(editors). Formal Theories of the Commonsense World, pp, 71-107. Ablex, Norwood; see 
also the book by Russell and Norvig just cited). It seems that simplified infoxmatlon 
modeling can be obtained when static and dynamic aspects are not sep^ted from each oth^ 
from the beginning. Therefore, the invention considers an approach which views spatial and 
temporal aspects in an integrated way, and takes the notion of event as central 

Quite generally, an important tradeoff in the area of knowledge rcfpresentatton 
deals with the question of expressive power versus reasonmg efficiency* A high expressive 
power may lead to intractibility of reasoning, while efficient reasoning may only be 
obtainable in combination with limited expressivity. This has been an argqmOTt in fevor of 
speciali^^ed knowledge representation schemes, combined wi& dedicated reasoning 
procedures and algorithms. 

Here, the cont^ infoimation mainly considers the following aspects: 

- context! situation, events, people present etc. 

- knowledge about context, determining the way in which one can reason about context, 

- people and their preferences regarding content, in a context-dependent way. 

Furthermore the context can be considered as a combination of events. The 
word event should be interpreted in a very general way. Bach event is associated to a chunk ' 
(that is, a subset) of space-time, where space includes not only the ordinary physical space 
but also virtual dimensions. It is sometimes convenient to simply identify an event with a 
chunk of space-time* For example, an object is viewed as an event (spreading out over time), 
and a time interval is also viewed as an event (spreading out over space), A person can also 
be regarded as an event, perhaps regarded throughout his or her entire lifetime, or only for a 
day. The presence of a person in a certain place during a certain horn: can also be regarded as 
an event 

This general way of looking at events may simplify expressions of and 
reasoning with context knowledge. It can lead, for example, to an unification of static objects 
and dynamic dhanges. 

One of the relationships between events is tlie subevent relationship, which 
specifies that a certain event is part of another event In this case, the (space-time chunk of 
the) first event is a subset of the (space-time chunk of the) second event. So events may be 
composed of other events. 
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One can fona the coxijimctioii of two events^ whose space-time chunk is the 
union of the space-time chunks of the two events. Conjunction of events is denoted by the 
infix operator A, or by the keyword AND. The most general event is any-event, which 
occupies the complete space-time. The most specific event is empty-event, which occupies 
the empty subset of space-time, and there&re does not represent a realistic event 

The real physical space can be extended with virtual dimensions. In particular, 
the set of URLs (URIs) describing items on the World Wide is thou^t to be part of 
space. 

For £he purpose of dealing wifli oont^Kt-aware media sj^tMis liic following 
kinds of events can be distinguished! 

- Physical events do not involve people, but deal for example with configuration of 
devices, including lightings curtains, and phones. This includes triggers, such as the 
ringing of the telephone. 

- Content events may describe the existence of content items, and also Ihe fact that certain 
content is being presented in a certain time interval at a certain place, for example with a 
certain sound level. Hence a content event may involve ordinary space as well as a tIRL 

- People events involve people, of course. For example, people entering or leaving a room, 
sKpressions of emotioiL, etc, 

- Input events are expressions of certain people that are intended as input for the 
enviroranent (that is, the system). Examples; an explicit request, feedback to certain 
musiCi, an action with the effect to rate a certain piece of music. So the class of input 
events can be viewed as part of the class of people events. 

Physical events, people events, or input events can be referred to as context 

events. 

Certain high-level user situations can be referred to as a special kind of people 
events* Several examples of such user situations can be given as follows: Alone:relaxing, 
Aloneiconcentrated, Party:big (festive), Partyrsmall (conversation), Mobile, Car, Romantic, 
Waking up. Going to sleep, Nobody preset. 

Knowledge about context is described in terms of What will be called atomic 
events. Events that are not expressed as a conjunction of events, are required to be atomic 
events. For each atomic event, at least one of the following three attributes should be 
included in an event description: position, or region of space; time or time interval; name of 
event, or, more specifically, who or what is stated by tliis event For complex space-time 
chunks, a more complicated description of space and time aspects may be required. In 
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addition, it can be relevant to include metadata about eiveaits, for example who or what stated 
Uie evenly at what time. It shonld be noted that incomplete infonnation is allowed. As an 
exaa^e, the starting time of an event (the birthdate of a percon, for instance) might be 
imknown. Furtheraiore other attributes can be included in an event description without 
5 departing from the concept of the invention. 

An important issue involves tlie detection of user situations. Instead of telling 
ihe system that a group of people who were sitting and talking, suddenly started to dance 
when a femous song started to play, this can be automatically concluded from the readings of 
certain pressure sensors. The 'level of ambient intelligence* can be higher when there are 
0 more high-level user situations that can be automatically deduced from low-level, automatic 
observations. 

R^oning about events can be done using mathematical relations between 
events, which can be expressed using subcvcnt rules. Snbevent roles express that a certain 
evait is part of another event: 



(SUBEVENTeve«i4,evawB) 

This rule specifies that the space-time chunk ofev&aA is a subset of the space- 
time chunk of events. In this syntactic description of a subevent rule, eventA is called the 
left-hand side and eventB is called the light-hand side of the rule. The left-hand side of a 
subevent rule can be a conjunction of a finite number of atomic events, while the right-hand 
side of a subevent rule should be an atomic event. This requirement on ^ left-hand side and 
ttie riaiht-^haad side of a subevent rule detomines the possible extents of the mathematical 
relation speoifiedby a set of subevent rules. The basic reasonhig step involving subevent 
rules is a form of modus ponens, described as fellows. 



eventd AND (SUBEVENT eventA. eventB) imply eventB. (2) 

A subevent rule can be stated to hold when, if each atomic event in its left- 
hand side ^Kes to a curtain context, Ihe atomic event in its right-hand side can also be 
concluded to ^ply to the context Hence subevent rules allow the possibility to state 
sufBcient conditions for the deduction of user situations. The main purpose is to be able to 
draw conclusions about high-level user situations when given low-level sensor data about 
context of use. As an example, a subevent rule might conclude from the events 'there is only 
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one person present' and "sitting in armchair' that flie event (viser situation) 'alone relaxing' 
holds. Far another person, the conclusion from the same two events ndght be *alone 
concentrated' instead. Hie use of subevent rules makes such choicejs flexible and 
cifstomizable, and can be put under the control of users. 
5 In ordw to describe user profiles, profile rules of the following fomi are 

included: 



(PROFILE user^ givenEyenh possibleSlvent, action). (3) 

10 Note that other notations can be u$ed too for subevent rules and profile rules 

without departing from the concept of the invention.. 

The first attribute in such a profile rule indicates the user for which the rule is 
expressed. The next two attributes describe a given event and a possible event, respectively. 
The given event can be a conjimction of a finite number of atomic events, while the possible 

15 event should be an atomic event. The last attribute describes an action concerning the 
possible event of the rale that should be reali2:ed3 in the view of the user, when the given 
event of tiie rule actually takes place. An example of an action is do: this action requires the 
realization of the possible event when the given event occurs. When the actuators include 
devices controlling lamp$> for example, profile rules might be used tbat include actions to 

20 adjxist lighting conditions when certain conditions are satisfied. Another example of an action 
that can appear in a profile rule is the action to rate the possible event for the situation that 
the given event ooours. Values of such ratings can be expressed on a five-point scale, for 
example: then, a rating can be denoted by raUng[i]y where / is between 1 and 5. 

In a l^^ical application, the given event in a profile rule describes context^ and 

25 the possible event describes content But a user may also use profile rules to express other 
likes or dislikes or instructions, such as: given a certain song, another song is also very 
interesting; when the telephone rings, turn the sound level down; when I am alone and 
concentrated, please do not disturb. By using a conjunction to include two users in the given 
event of a role, one can build up a profile fer a specific pmr of users. As was already 

30 mentioned, possible events in profile rules should be atomic events. More particularly* we 
can require possible events in profile rales to be stereotypes^ which are identified with music 
genres. 

The query formulation process 124 can be described as follows: 
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although users axe also enabled to express desires to the system, the query 
fonnulation ooznponent is intended to contribute by being able to automatically fonrnUate 
queries on the basis of context information. The query formulation conq>oneat deJivers 
infonnation about desired content and possibly also about the current context The query 
5 fonnulatiott component combines the relevant individual user profiles and at>plies these to the 
ouirent context, using a certain kind of reasoning about the coatexti to find a suitable 
descr^tion of desired content. The query formulation output can be a list of weifih£e4 
'stereotype- user proffles. On the basis of the irqmt ftom the query formulation componait, 
the retrieval system deHveis a list of content identifiers (a list of content URLs and possibly 
10 associated annotation). 

The qu«y &rmulatiott process 124 comprises the following steps: 
First, a context determination step applies the subevent rules to the event 
descriptions recording the events detected by the sensors to find the complete set of atomio 
events describing the cmrent context. Such a resulting set of events is caUed a context 
IS descnptim. The context determination step can be viewed as performing an interpretation of 
the input observations of the sensors. For example, the context determination step typically 
translates certain low-level obswvatious into hlgji-levej user situations. Note that in general 
the context det^mination step may involve 'chaining' of rules. That is, a subevent rule may 
be ^Ucable to an event that was obtained by ^ying another subevent rule. 

The context determination stej) uses most of the computation required for the 
query formulation procedure. In order to show that its computational complexity is low- 
degree polynomial, an algorithm fcr the context determination step is given. The algorithm 
uses two variables, distinguished by a capital: Context and Rule. The value of the variable 
Cont^ is taken to be a set of atomic events. 



20 



25 



Context set of irrput events 
repeat until Context remains unchanged 
for each subevent rule Bule do 
if left-hand side of Rule is contained in Context 
th«i add ri^-hand side of Rule to Context 
return Context 



Let e be the total number of atomic events appearing in the input and in the 
subevent rules, let j be the number of subevent rules, and let k be the maximum number of 



PH1SIL021071EPP ^ ^ 0-2 21.10.2002 15:0lJ 



16 21.10.2002 
atomic events that appear in a subevetit rule. Then, it follows that the time complexity of this 
aXgotithtu for the context d^terminatloti step is 0(e^skX 

Second, a preference determination step applies the profile rules to a context 
description to detemjiae a set of possible events combined with rating values and the persons 
5 who gave these ratings^ and to determine the events that should be realized ui the view of the 
persons involved. If a user has two profile rules such that the given event is included in the 
context description, and if the given event of the first rule is more specific than the giveoi 
event of the second rule, then only the first rule is selected in Uie preference deteimination 
step. Here, an event is taken to be more specific than another event if it is a conjimction 
10 inclndiag all atomic events of the second and if it also includes additional atomic 
^events. 

Denoting the set of users present in the current context by Ue^ the set of 
stereotypes by and fhe set of actions that can be assigned to stereotypeis in profile rules by 
the preference detennination step essentially detennines a mathematical fimction 

15 

for each user ueU„, where S^^^S is the sot of stereotypes selected in the profile rules for 
user u in the preference determination Step. 

The output of this preference determination step is used in the query creation 
20 step, which generates the actual query that is sent to the retrieval component The query 
creation step detennines a weight ps for each stei:eotype s^S^ia such a way that 0:< <1 

and i>i =1 • Several possibilities for the query creation step can be considered. In order 

to describe these, some terminology needs to be introduced. Bach user u^U^is given a tdser 

priority fu in such a way that 0 </„ <1 and ^^^^ fu^^- Moreover, each action a^Ais 

25 assigned a number w(a)^ 0 called an action weight. 

As an example, the following actions can be considered as previously 

described: 



30 



A^{do,rating]i]:l£i<5}. (4) 
These actions can be given the following weights, for example: 
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H'(rfb)=5,H'(5)«3,H'(4)=2,w(f)=0(i£3). 

Given the user priorities^ fee fimctions ^>„ , and tbe actions weights as 
just defined, the weight of a stereotype a-ei- can be defined to be 

In words, the outer sum is taken over all users in the current context for which 
ihe stereotype s is selected in the preference deteanlnation step. Jn this de&rition, the 
denominator are introduced to diminish the influence of each individual profile rule 
aasardon forauser for many stereotypes ear in tHe profile rules for the current 
context. It can be proved that this definition satisfies 2,^^ = I . 

Many que^^ creation strategies can be defined by by uaing formula (6) in 
combination with specific values of the user priorities^ For exan^le, the eyerybo^ eaual 
strategy (E) gives each user equal priority: 

Another strategy. to (D), gives a speci^^ 

ttie hi^tpriority/,, while ibe oflier usere each get the «ame. lower priority: 

Anex«a^leofthlsstrategyisiheAa^.^«^^(H). dedicated to the host of a 
20 meeting or party, fbr example. 

Each of the strategies E. D, H can be supplemented with another step, called 
make least happy mare h^py (L): the idea is that if a person does not like a stereotype then 
th,s stereotype is not included m the query formulation output This can be reahzed as 
fellows; 



15 



25 



if P„ (*)=lor2 for some user u^U,, thenputp^^O. Subsequently, the 
weights p. needtoberenoimalized so that 2,.,P,=l.Itd«)uMbenotedthat.mp^^^^ 

it isposaible that each of^wei^p^^ouldbecomeOin this way. in which case this step 
caimot be applied. 



25 



30 



aj..uui .c>!Jwc x3-i*=. .- 21-10.2002 15:02 

PHNL021071EPP 

18 21.10J20Cy2 
As an alternative to the strategies just discussed, fliere is a majority strategy 
(M). ^ich is not defined in tenns of Equation 6, but '^^oh singly returns the stereotypes 
that appear most often wilh the top acdan do: 

5 and gives these stereotypes equal weight (usually, tiiis willlead to just one stereotype). 

The query creation step can use extber one of the strategies E, B, or H 
(possibly supplemented with L), oi Uie strategy M. It is natural to give control over the 
choice of the query creation strategy to a host user. It should be noted that alternative query 
creation strategies can be defined without departing fiom flic concept of the invention. 

Now tbe functionality of the information retrieval process 11 8 is fbxtfaer 
described. Wtix the current invention gristing recommender systems oaabemade conteart- 
aware= and applicable to groups of people instead of only individual persons. Hereto, 
collaborative filtering (see. e.g., Goldberg, D., Nichols. D, Oki, B.M., and Terry, D. 1992. 
Using Collaborative Filtering to Weave an Lofbxmation Tapestry. Comm. ACM. 32<12) pp. 

15 51-60, or Breese, J., Hedcennan, D., and Kadie, C. 1998. Empirical Analysis of Predictive 
Algorithms for CoUaborative FUtering. In Proceedings of flie 14th Conference on Uncertainty 
in Artificial InteUigence, Madison, WI.), can be used. 

A standard procedure f<» coUabotadve filtering can be described as follows; 
The central data is a user database, containing votes t ftom users u on items 

20 ; . In the typical application area considered in this invention, items are media content items. 
If the application is music selection, then items can be songs. The set of aU users is denoted 
by U and the set of all items by /. Although ihe algorithm is more general, it is assumed thai 
the votes are taken from a five-point scale, with values from 1 to 5. If /„ is the set of items on 
which user w Iws voted, thai the mean vote for user u is: 



lfw(u.u') is defined as the user similarity between user w and user w' and U^ as 
tbe set of users with nonzero user similarity scores (relative to user «) then the predicted vote 
I of user « for item i is described as follows: 



where is a normalization constant defined by means of the equation 
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For the user similarity w(u.u') fh&ice are several definitions in use. Hereto, the 
vector similarity definition can be used; 

w(u,^.^h Z i^^--' , J'''' , • (8) 

Here the squared terms in the denominator serve to normalize votes so tShat 
5 users that vote on more titles will not a priori be more similar to otiier usera. Note that vector 
similarity in collaborative filtering is an ad^tation of vector similarity in information 
retrieval. Uaera take the role of documents, titles take tiie lole of words, and votes take the 
role of word fieqaoicies. 

For a user «, the output of the collaborative filtering process is a list of items /, 
10 ordered by means of the values ofi?k^ t. Note that this process delivers recommendations for 
an individual user, whose votes are assumed to be present in the user database. 

In order to ^ply ^s procedure to groups of users, whose votes do possibly 
not ^pear in ifae user database, in a context-dependent way, the votes firan a new user can be 
added to flie user database. The disadvantage of this approach is that it can lead to scalability 
15 problems because tiie user similarity matrix w (u, u') must be recalculated at run-time. 
Another problem is that the votes v^, i are context-lndepeaident: for example, they do not 
make clear that a certain user niay want classical music in one situation, and popular music in 
another situation. 

ii order to solve these problems, it is allowed to define a group profile, in a 
20 dynamical way, as a weighted Unear oombination of existing user profiles, and determine the 
prediction of the group by taking a weighted average of the individual user predictions. If G 
is a group of users and w„, o is the weight of user profile u in this group, than the groitp 
prediction po. i for an item i can be defined as follows: 

25 Here the weights Wu. o are required to satisfy ^ w„,<y =1 . 

Instead of assuming that the individual data of the users in the current context 
are in the user database used by the collaborative filtering procedure, a set S of stereotypes 
can be taken. Stereotypes are viewed as 'users' in the collaborative filtering database, which 
are identified with content genres, and which can be defined in terms of votes on particular 
30 content items. Examples of such stereotypes could be: LatinMusio, Rock, ClassicalMusio. 
Sinatra, Waking-up, RomanHo. 
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The query formulation procedtjre, as previously discussed, delivers a set of 
nomiegative weighty pg of stereotypes s^S such that ^ «1 . These weigbts are used to 
fiud tecommeruiations based on collaborative filtering, ia the way previously described, with 
the set of stereotypes S taking the place of the groiq> of users G in formula (9). Now, the 
S votes of a user who is present in the cuireat context do not have to be in the user database 
used by the collaborative filtering procedure. Therefore, the profile rules used to determine 
us^ profiles in a context-dependent way can be completely independent fi:om the 
collaborative-filtering database Vu, {. There is no need for frequent updates of the user 
similarity matrix. 

10 An einbodiment of the invention is aix application sceuario, together with an 

indication of the context information that can be used to reaUze this scenario. This example 
uses all the technology discussed above: the general notion of events (in particular, user 
situations), suhevent mles, and profile rules; context determination, preference determination, 
and query creation; retrieval based on collaborative filtering by means of stereotypes. This 

1 5 scenario illustrates another feature of the invention, namely that a context does not need to 
refer to one place, but can refer to distinct, disconnected places where people reside who 
want to share the same media cont^t. For example a person sitting in a car wants to share 
songs with a person sitting at home. Current media systems based on the internet, such as the 
internet radio, enable such sharing of tailored media content between places that are remote 

20 fi^om each other. The invention can also be applied ia such situations. A source of complexity 
in the example is formed by the user profiles and the context Icnowledge, which can reside in 
different files on the Semantic Web. How this is done is illustrated in the following section. 



The scenario reads as follows 
25 Tom is in the rooni, listening to classical music^ 
AnUfl Kate, Bob enter the room. 
Music changes accorditig to ttie profiles of all users. 

Somebody brings (puts on the table) a palm tree, which is associated with a special kind of 
party, a Latin party. 
30 Music changes again. The party continues. 

Mike calls and says that he is stuck in ttie traflic jam and will be 30 minutes later. 

Tom offers him to listen to the music^ which is now playing at the party. Mike says; '^that's a 

very good idea". 

Music starts playing in the car... 
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The party is finished. 

Everybody is gone, everything is switched off. 

The following subevent rules &rm ^ context knowledge that can be used to 
5 : realize the scenario: 

(STJBEVENT userA, person) 
(SUBEVENT uperB, person) 
(SUBBVENT userC, person) 
(SUBEVENT nsedD, person) 
10 (SUBEVENT userE, person) 

(SUBBVENT #peisons=l AND sittmglnAimchair, userSituationAK.) 
(SUBEVENT ifpeisons >=3, userSituationSP) 
(SUBEVENT persons =0, userSituationNP) 
fimction: #personsO 

15 

Here a function #persons is intooduced to count the number of persons present 
Moreover, AR stands for 'alone:relaxing', SP for 'small party*, and NP for 'nobody present*. 
As an example, here are a few of tile profile rules: 

1 

20 (PROFILE userA, userSituationAR, ClassioalMueic, do) 
(PROFILE userA, userSituationSP, PartyMusio, do) 
(PROFILE TiserA, userSituationNP, NoMusio, do) 

(PROFILE users, userSituationSP AND PaimTreePutOnTable, LatinMusic, do) 
(PROFILE userB, userSituationAR, songX, rating[5]) 

25 

Below, the scenario is replayed and the events detected by sensors as well as 
die events derived by the systam are summarized. 

Ih the initial phase, when Tom is alone, the foUowing events have been 
detected by fba input sensors; 
30 usecA, sittinglnAimchair, 



and the following event is derived by the system: 
userSituationAR. 
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M this situation, the system seleots classical music. When Aim, Kate and Bob 
entered, the sensois detect the following everts; 
userA, userB, userC, iisecD, 



5 and the system derives the followiiig event: 
userSituationSP. 



In this situation, party music is selected by the system. After the palm tree haa 
been put on the table, the saasors detect the foUowhig events: 
xo userA, userB, userC, userD, PalmTreePutOnTable 



and the following event is derived: 
usetSituationSP. 



J 5 ijj this sltualion, the system selects Latin music. After Mike called, the only 

chan^ is the addition of one us» to the context file, in such a way that the room is thought to 

be extended with Mike's car. 

At flie end of the scenario, everybody is gone, there are no events in the 

context file, the system deduces die following event; 
20 iuet$ituationl^, 

and no music Is played. 

Figm» 2 illustrates a model of RDF data describing the contejct information 

l»eviously discussed. Sevwal basic RDF Schema pKqjCTties are denoted by an arrow through 

a circle, which encloses a letter. This holds for tbe properties rdfersubClassOf and 
25 rdfe:8ubPiopertyOf (for both, the letter s is used), as well as the properties rdfe:domaTn 

(letter: d) and rdfeaange (letter: r). Class names are enclosed m rounded rectangles, property 

names in ovals, and naxoes of lit^uls in rectangles. 

The tmg^n classes are yme:Evettt and yme:Rttle. The class ymeiRule bas two 

aubclasses: yme:subBventRule and yme.-profileRule. The central property is yroe:itsEvent, 
30 with subprc^arties yme:itsC3iveoBveot, yme.itsPossEvent, yme:itsLeffEvent, and 

yme:itsRightBvent The range of Hie properly yme:itsEvent is flie class yme:Bvent The 

domain of both prqperties yme:itsQiv6nEvent and yme:itsPossEvent is the class 

yme:piofileRule. The domain of both properties yme:itsLeflEvent and yme:itsRighiEvent is 
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l3ie class ymeisubEventRule. Finally, ther^ is the property ymeritsAotion, with, domain 
ym^jprofiaeRuJe and rang© Action (a Literal type). 

For simplicity. Figure 2 does not include the resources rdfiProperty, rdfsiClass 
and rdfs:Resource, and the various rdf;type stat^ients used to indicate that each, property is a 
5 property and each class is a class, 

When the Semantic Weh lanjguage RDF is used, titie following kinds of RDF 
files can bo iucluded: 

- a context file describing the context as detennined by input sensors as a combination of 

events, 

10 - a context knowledgefile, containing subevent lules describing general fcnowledgo for 
reasoning about the context, 

- ^profile file for each user, containing profile rules. 

If a user is present in a certain context, then the context file contains a link to 
ttie profile for this user. Explicit user input is dealt with using input events added to the 
15 context file. 

The following examples illustrate the way in which subevent rules and profile 
rules are described in RDF. The subevent rule 
(SUBEVENT eventA AND evenffi, wentC) 
can be described in the following way: 
20 <5rdf:Descxiption rdf:about='litip:/A.7yme/ooKn»rdflfeubBventRuleA"> 
<tdf:type rd£resource='Titlp://..yyme/jme#sttbEvenlRule''> 
<yme:iteLeftBvOTt rdfh:esouroe?="htlp:y/..yytne/coKn.rdfSeYentA"yi> 
<yme:itsLeflEv^t rdfiresource^"htlp://. . ./yme/coKn.rd6feventB"/i> 
<yme:itsRigJitEv6nt rdfiresource?^"http://, . •/yme(^coKn.rd©feventC"/i> 
25 ^rdfiDescription?* 

The various URLs are abbreviated for notational puiposcs. The profile rule 
(PROFILE usecA, eventA, evcntB, actionA) 
can be described in Ibe following way: 
<rdf:Descripticnrdeaboufr*'Tittp:/A.,AisPr-u5erA.rd%r 
30 ^tdfitypo rdf:resource="bttp;/A-./yme/yme#profileRule"/> 
<^mie:its<3iYenEventrdf:resource^^Tittp:yA.7yme/coK^ 
<yme:itsPossEventrdfiresource='"bttp:/A.iyme/coKn4'df#evenffi 
<rdf:itsAction>actiorLA<yrdf:itsAction> 
</rdfJOescription> 
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In addition, the eveaite fh^t appear in tliejse mles can be declared to be events, 
in the following way. 

<td£Description rdfiabout^'Tittp;//. . ./yme/coKn.rdfif^eventA"> 
5 <rdf:type rdfrresowce="http:/A . ,/yme/yine#Event"/> 
<yrdf:Descriptioit> 

These examples show that subevent rules and profile rules are also represented 
in KDF/XML in the form of a IpM of rules. These RDF statements are accompanied by RDF 
10 Schema information that is used for interpretation, The schema for the RDF data just 
illustrated is illustrated in Figure 2, 

The query formulation process can be implemented as follows: the initial 
reasoning steps (context determination and preference detemination) can be made available 
via a special API, which is used to realize the query creation step in combination with the 
15 appropriate types of RDF files. The API can be realized in Java, for example, using a Java 
class library for manipulating RDF and RDF Schema infonnation. as for example The Jena 
Semantic Web Toolkit, developed by Hewlett-Packard., see 
littp://www.lipLhpxom/semweb/jena-^ 

Several advantages of the ounrent invention can be summarLzed as follows. 
20 First, existing media reconmienders can be made context-aware without having to rewrite 
fliem fiom scratcii. Second, by using standard Ihtemet and Web technology interoperability 
and convenience to the user can be enabled. Both the Internet radio at the party and the radio 
in Mike's car (see the scenario previously discussed) can access flie same playlist simply by 
selecting the same URL. Third, by making user profiles available on the Web, the same iiset 
25 profile can be accessed in other context-aware media systems. 

. Figure 3 lUustrafces the main parts of a system according to the invention in a 
sdiematic way. The system 300 comprises a random access memory 302, a software bus 310, 
and a central processing unit 3 12. The memory 302 can commimicate with the central 
processing unit 312 via software bus 31 0. The miemory 302 comprises computer readable 
30 code 304, 306, and 308, The conapuler readable code 304 is designed to perform the query 
formulation process as previously described. The computer readable code 306 is designed to 
perform the information retrieval process as previously described and the computer readable 
code 308 is designed to perform the presentation generation process as previously described. 
The information retrieval process is designed to retrieve media content that is stored upon a 
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remotely located storage system 314. The storage system 314 and the system accordiiig to the 
invention are connected to eacih other through the internet The storage system 314 can be a 
server that comprises a database 3 1 6 comprising for example audio and video files. The 
storage system 314 can also be distributed over a nmnber of servers and each server 
5 comprises a number of audio and/or video files. The system is described by means of 
example as a software system. However, dedicated hardware or combinations of software 
with hardware, like programmable hardware tbat is designed to perform the mentioned 
method steps is included too. 

Figure 4 illustrates internet-enabled devices comprising the system according 
10 to the invention in a schematic way. An internet-enabled television set 402 comprises the 
system according to the invention 410 and is bilateiaUy connected via an internet connection 
408 to an iotemet-enabled radio 404. The inlwnet-enabled radio comprises 404 a system 
according to ihe invention 412 and is bilaterally connected via the internet comection 408 to 
a personal computer 406. The personal computer 406 comprises a system according to the 
15 hivention 414 and is bilatersUy connected to ihe television set 402. The personal computer 
406 can download the computer readable code 41 8 that is designed to perform the method 
according to the invention as previously described. The computer readable code 418 can be 
read by the personal computer 406 ftom a storage device 416, like a C2D, CD+RW, DVD, etc. 
The television set 402, radio 404, and personal computer 406 are eacainples of intemet- 
20 envied devices. Odaer devices that are internet-enabled are also feasible like for example a 
mobile phone. 

The order in the described embodunents of the method of the cijtrent invention 
is not mandatory, apersonskilledjniheartmay change the order of steps orperformst^s 
cencunently using threading models, multi-processor systems or multiple processes without 

25 departing fixan the concept as intended by the current invention. 

It shouldbe noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and ftat those sIdUed in the art will be able to design many alternative 
enibodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. The 

30 word "comprismg" does not exclude the presence of elements or steps other than those Hsted 
hi a claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such demaats. The invention can be implemented by means of hardware 
comprising several distinct elements, and by means of a suitably programmed computer. In 
the system dahns enumerating several means, several of these means can be embodied by 
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one and the same item of computer readable software or hardware. The mere fact that certain 
measures are recited in mutually different dependent claims does not indicate that a 
combination of these measures cannot be used to advantage* 



PHNL021071EP1> ^ 033 21,10.2002 1 



27 21.10.2002 
CLAIMS: 



1. Method of presenting media content to a user or group of nseta, wherein the 
media content resides on a storage system and the metihod comprises the steps of: 

defining a query to retrieve the media content, which query is appropriate for 
the nser*s situation by using context infomiation; 

retrieve fho queried media content from the storage system; and 
presenting the queried media content to the user or group of users, 

2. Method of presenting media content to a us« or group of users according to 
claim 1 , wherein the context information comprises at least one of sensor data about at lea^t 
one person present, sensor data about at least one object present, a context-dependent user 
profile^ and a cont^t-dependent group profile. 

3. Mefliod of presenting media content to a user or group of users according to 
clpim 1, wherein the context infonnation comprises a combination of events of which each 
event is described by means of at least one of information about space, information about 
time, and infomiation about who or what is described by the respective event. 

4. Method of presenting media content to a user or group of users according to 
claim 3, wherein the context information contains a mathematical relation between the events 
to enable reasoning about the events. 

5. Method of presenting media content to a user or group of users according to 
claim 3, wherein events comprise at least one of a physical event, a content event, a people 
event, and an input event. 

^- Method of presenting media content to a user or group of users according to 

claim 2, wherein the user profile and the group profile are based upon at least one profile 
rale, and the at least one profile rule describes, for the user or group of users, an action 
conc^ng a possible event which possible event should bo realized according to the user or 
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group of users when a given event takes place and, the method comprising Hlo stqp of 
applying the at least one profile rule to the context infonnation which includes ttie given 
evOTt, in order to detemiiiie the possible event 

5 7, Metiiod of preseGoting media content to a user ot gronp of users according to 

claiin 6i wherein the possible event is detennined using a rating value and the user who gave 
the rating value. 

8. Method of presenting media content to a user or group of users according to 
10 claim 2, wherein a Semantic Web language is used to represent infonnation about the media 

content and the context information. 

9, Method of presenting media content to a user or group of users according to 
claim 2, wherein flie user profiles of different users are separately stored on different places 

15 on the internet. 

10, Melhod of presenting media content to a user ox group of users according to 
claim 6, wherein the mathematical relations for reasoning about events are located on a 
centf al server. 

20 

1 1 . Method of presenting media content to a user or group of users according to 
claim 6, the method comprising the step of applying a query creation strategy to determine 
the at least one profile role to apply. 

25 12. Method of presenting media content to a user according to claim 1 j the method 

comprising the step of retrieving tibie queried media content by means of collaborative 
filtering* 



13. System for presenting media content to a user, wherdn the media content 

30 resides on a storage system and the system comprises: 

defining means conceived to define a query to retrieve the media content, the 
query being ^roprlate for fh© user's situation by using context information; 

retrieving means conceived to retrieve the queried media content fi:om the 
storage system; and 
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presenting means conceived to present the queried media content to the user, 



1 4. Computer program product designed to perform the method according to any 
of the claims 1 to 12. 

1 5 . Information canier comprising Hie computer program product according to 
claim 14. 



l^t^diainment d6\dce comprising the system according to claim 13, 
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ABSTRACT: 



The invention relates to a method of presenting media content to a user or 
groitp of Tisers^ wherein th© media content resides on a storage system and the method 
comprises ttie steps of defining a query to retrieve the media content, which query is 
appropriate for the user's situation hy using context inforoiation; retrieve the queried media 
content jfrom the storage system; and presenting the queried media content to the user or 
group of us^. 

Kgorel 
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